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Backtracking Search \ v 

Backtracking search is the basic uninformed algorithm for solving CSPs 

CSPs are a special kind of search problem: 

States are partial assignments 
Goal test defined by constraints 

Idea 1 : One variable at a time 

Consider assignments to a single variable at each step 
Idea 2: Check constraints as you go 

Consider only values which do not conflict previous assignments 
“Incremental goal test” 

Backtracking = DFS + variable-ordering + fail-on-violation 



Improving Backtracking 

Filtering: Can we detect failure early? 

Keep track of domains for unassigned variables and 
cross off bad options 

► Ordering: 

Which variable should be assigned next? 

In what order should its values be tried? 



► Structure: Can we utilize the problem structure 
in some way to get a better algorithm? 


Filtering: Forward Checking 


Forward checking: Cross off values that violate a constraint when adde 
to the existing assignment 
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Filtering: Constraint Propagation 

Forward checking propagates information from assigned to unassigned 
variables, but doesn't provide early detection for all failures: 
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► NT and SA cannot both be blue! Violate the constraint 

Why didn’t we detect this yet? Forward checking does not provide 
early detection of failures like this 

Constraint propagation: reason from constraint to constraint 
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Consistency of A Single Arc 

An arc X -» Y is consistent iff for every x in the tail there is some y in the 
head which could be assigned without violating a constraint 



Forward checking: Enforcing consistency of arcs pointing to each new 
assignment 

Delete from the tail! 




Arc Consistency of an Entire CSP 

A simple form of propagation makes sure all arcs are consistent: 
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Important: If X loses a value, neighbors of X need to be rechecked! 
Arc consistency detects failure earlier than forward checking 

► Can be run as a preprocessor or after each assignment 

What’s the downside of enforcing arc consistency? Remember: Delete 

from the tail! 







Limitations of Arc Consistency 


After enforcing arc consistency: 

Can have one solution left 

Can have multiple solutions left 

Can have no solutions left (and not know it) 



Arc consistency still runs inside a backtracking 
search! 
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K-Consistency 




K-Consistency 

Increasing degrees of consistency 


► 1 -Consistency (Node Consistency): Each single node’s domain 
has a value which meets that node’s unary constraints 

2-Consistency (Arc Consistency): For each pair of nodes, any 
consistent assignment to one can be extended to the other 

K-Consistency: For each k nodes, any consistent assignment to 
k-1 can be extended to the k th node. 


Higher k more expensive to compute 

(You need to know the k=2 case: arc consistency) 
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Strong K-Consistency 

Strong k-consistency: also k-1, k-2, ... 1 consistent 
Claim: strong n-consistency means we can solve without backtracking! 
► Why? 

Choose any assignment to any variable 
Choose a new variable 

By 2-consistency, there is a choice consistent with the first 
Choose a new variable 

By 3 -consistency, there is a choice consistent with the first 2 

► ... 

Lots of middle ground between arc consistency and n-consistency! 
(e.g. k=3, called path consistency) 




Ordering 




Ordering: Minimum Remaining Values 

Variable Ordering: Minimum remaining values (MRV): 

Choose the variable with the fewest legal left values in its domain 

Why min rather than max? 

Also called “most constrained variable” 

► “Fail-fast” ordering 



Ordering: Least Constraining Value 

Value Ordering: Least Constraining Value 
Given a choice of variable, choose the least 
constraining value 

l.e., the one that rules out the fewest values in 
the remaining variables 
Note that it may take some computation to 
determine this! (E.g., rerunning filtering) 



Why least rather than most? 

Combining these ordering ideas makes 
1000 queens feasible 




Structure 









Problem Structure 


Extreme case: independent subproblems 

Example: Tasmania and mainland do not interact 

Independent subproblems are identifiable as 
connected components of constraint graph 

Suppose a graph of n variables can be broken into 
subproblems of only c variables: 

Worst-case solution cost is 0((n/c)(d c )), linear in n 
► E.g., n = 80, d = 2, c =20 
2 80 = 4 billion years at 10 million nodes/sec 
(4)(2 20 ) = 0.4 seconds at 10 million nodes/sec 



Tree-Structured CSPs 



Theorem: if the constraint graph has no loops, the CSP can be 
solved in 0(n d 2 ) time 

Compare to general CSPs, where worst-case time is 0(d n ) 


Tree-Structured CSPs J 

► Algorithm for tree-structured CSPs: 

Order: Choose a root variable, order variables so that parents precede children 
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Remove backward: For i = n : 2, apply RemovelnconsistentlParentlX,),^) 

Assign forward: For i = 1 : n, assign X< consistently with Parent(X,) 

► Runtime: 0(n d 2 ) (why?) 









Tree-Structured CSPs 


Claim 1: After backward pass, all root-to-leaf arcs are consistent 
Proof: Each X->Y was made consistent at one point and Y’s domain could 
not have been reduced thereafter (because Y’s children were processed 
before Y) 



Claim 2: If root-to-leaf arcs are consistent, forward assignment will not 
backtrack 

Proof: Induction on position 

Why doesn’t this algorithm work with cycles in the constraint graph? 
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Improving Structure 









► Conditioning: instantiate a variable, prune its neighbors' domains 
Cutset conditioning: instantiate (in all ways) a set of variables such that the 


remaining constraint graph is a tree 

Cutset size c gives runtime 0( (d c ) (n-c) d 2 ), very fast for small c 


Cutset Conditioning 


\ 

Choose a cutset 
/ 


Instantiate the cutset 
(all possible ways) 


Compute residual CSP 
for each assignment 


Solve the residual CSPs 
(tree structured) 





Thanks 


